Linear and Nonlinear Data Dimensionality Reduction
نویسنده
چکیده
This report discusses one paper for linear data dimensionality reduction, Eigenfaces, and two recently developed nonlinear techniques. The first nonlinear method, Locally Linear Embedding (LLE), maps the input data points to a single global coordinate system of lower dimension in a manner that preserves the relationships between neighboring points. The second method, Isomap, computes geodesic distances along a manifold as sequences of hops between neighboring points, and then applies Multidimensional Scaling (MDS) to these geodesic distances instead of Euclidean distances. To provide depth of understanding as well as background for comparison, the classical linear techniques MDS and Principle Component Analysis (PCA) are derived from three different approaches. The algorithmic, applicability, and implementation issues of the three papers are discussed in the common framework of data dimensionality reduction. Simple experimental results and suggestions for improvement are presented.
منابع مشابه
مدل ترکیبی تحلیل مؤلفه اصلی احتمالاتی بانظارت در چارچوب کاهش بعد بدون اتلاف برای شناسایی چهره
In this paper, we first proposed the supervised version of probabilistic principal component analysis mixture model. Then, we consider a learning predictive model with projection penalties, as an approach for dimensionality reduction without loss of information for face recognition. In the proposed method, first a local linear underlying manifold of data samples is obtained using the supervised...
متن کامل2D Dimensionality Reduction Methods without Loss
In this paper, several two-dimensional extensions of principal component analysis (PCA) and linear discriminant analysis (LDA) techniques has been applied in a lossless dimensionality reduction framework, for face recognition application. In this framework, the benefits of dimensionality reduction were used to improve the performance of its predictive model, which was a support vector machine (...
متن کاملAn Empirical Comparison of Dimensionality Reduction Methods for Classifying Gene and Protein Expression Datasets
The recent explosion in availability of gene and protein expression data for cancer detection has necessitated the development of sophisticated machine learning tools for high dimensional data analysis. Previous attempts at gene expression analysis have typically used a linear dimensionality reduction method such as Principal Components Analysis (PCA). Linear dimensionality reduction methods do...
متن کاملNonlinear Dimensionality Reduction Techniques and Their Applications
Dimensionality reduction is the search for a small set of variables to describe a large set of observed dimensions. Some benefits of dimensionality reduction include data visualization, compact representation, and decreased processing time. In this paper, we review two nonlinear techniques for dimensionality reduction: Isometric Feature Mapping (Isomap) and Locally Linear Embedding (LLE), and a...
متن کاملImpact of linear dimensionality reduction methods on the performance of anomaly detection algorithms in hyperspectral images
Anomaly Detection (AD) has recently become an important application of hyperspectral images analysis. The goal of these algorithms is to find the objects in the image scene which are anomalous in comparison to their surrounding background. One way to improve the performance and runtime of these algorithms is to use Dimensionality Reduction (DR) techniques. This paper evaluates the effect of thr...
متن کاملA comparison of linear and nonlinear dimensionality reduction methods applied to synthetic speech
In this study a number of linear and nonlinear dimensionality reduction methods are applied to high dimensional representations of synthetic speech to produce corresponding low dimensional embeddings. Several important characteristics of the synthetic speech, such as formant frequencies and f0, are known and controllable prior to dimensionality reduction. The degree to which these characteristi...
متن کامل